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A Hybrid Bat Algorithm 

Iztok Fister Jr.Q Dusan FisterJT] and Xin-She Yangj*] 

Abstract 

Swarm intelligence is a very powerful technique to be used for optimization purposes. In this 
paper we present a new swarm intelligence algorithm, based on the bat algorithm. The Bat 
algorithm is hybridized with differential evolution strategies. Besides showing very promising 
results of the standard benchmark functions, this hybridization also significantly improves the 



original bat algorithm. 
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I. INTRODUCTION 



Nature has always been an inspiration for researchers. In the past, many new nature- 
inspired algorithms have been developed to solve hard problems in optimization. In general, 
there are two main concepts developed in bio-inspired computation: 

1. evolutionary algorithms, 

2. swarm intelligence algorithms. 

The Evolutionary algorithms are optimization techniques [7] that base on the Darwin's 
principle of survival of the fittest [5]. It states that in nature the fittest indivi- 
duals have greater chances to survive. The Evolutionary algorithms consist of the follow- 
ing disciplines: genetic algorithms, evolution strategies, genetic programming, evolutionary 
programming, differential evolution. 

Although all these algorithms or methods have been developed independently, they share 
similar characteristics (like variation operators, selection operators) when solving problems. 
In fact, the evolutionary algorithms are distinguished by their representation of solutions. 
For example, the genetic algorithms [151 US] support the binary representation of solutions, 
evolution strategies [21 ED] and differential evolution [31 El I2H] work on real- valued solutions, 
genetic programming [21] acts on programs in Lisp, while the evolutionary programming [13] 
behaves with the finish state automata. The Evolutionary algorithms have been applied to 
a wide range of areas of optimization, modeling and simulation. Essentially, the differential 
evolution has successfully 

been employed in the following areas of optimization: function optimization |28j, large-scale 
global optimization [3], graph coloring [8], chemical-process optimization pQ. 

Swarm intelligence is a collective behaviour of decentralized, self-organized systems, ei- 
ther natural or artificial. Swarm intelligence was introduced by Beni in 1989. A lot of algo- 
rithms have been proposed since then. The Swarm-intelligence algorithms have been applied 
on continuous as well as combinatorial optimization problems [25]. The most well-known 
classes of the swarm-intelligence algorithms are: particle swarm optimization, ant colony 
optimization, artificial bee colony, firefly algorithm, cuckoo search and bat algorithm. 

Particle swarm optimization has been successfully applied in problems of the antenna 
design [T7] and electromagnetics [27]. The Ant colony algorithms have also been used in 
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many areas of optimization [20] [26] [22] . The Artificial bee colony shows good perfor- 
mance in numerical optimization [TH] [IS], in large-scale global optimization [10J and also in 
combinatorial optimization [21] [5] |30j. 

The Cuckoo search algorithm is a very strong method for function optimization and 
also for engineering optimization problems [31] [33] . The Firefly algorithm shows promising 
results in function optimization and provides good results also in combinatorial optimiza- 
tion [LJ. 

Echolocation is an important feature of bat behaviour. That means that bats emit a sound 
pulse and listen to the echo bouncing back from obstacles whilst flying. This phenomenon 
has inspired Yang [36] to develop the Bat Algorithm (BA). The algorithm shows good results 
when dealing with lower-dimensional optimization problems, but may become problematic 
for higher-dimensional problems because of its tending to converge very fast initially. On the 
other hand, the differential evolution [23] is a typical evolutionary algorithm with differential 
mutation, crossover and selection that is being successfully applied to continuous function 
optimization. 

To improve the bat-algorithm behaviour for higher- dimensional problems, we hybridized 
the original bat algorithm by using differential-evolution strategies. This Hybridized Bat 
Algorithm (HBA) was tested on a standard set of benchmark functions taken from literature. 
Results of our numerical experiments show that the proposed HBA can significantly improve 
the performance of the original BA, which can be very useful for the future. 

The structure of the paper is as follows. In Section 2, we introduced the original BA 
and the differential evolution algorithm and explain some biological foundations of the bat 
behaviour. In Section 3 we describe our novel approach to hybridizing the bat algorithm 
with differential evolution strategies. In Section 4 we illustrate our experiments and discuss 
the obtained results. The paper ends by presenting our plans for future work on HBA 
development. 

II. BAT ALGORITHM 

The Bat algorithm was developed by Xin-She Yang in 2010 [35]. The algorithm exploits 
the so-called echolocation of the bats. The bats use sonar echoes to detect and avoid obsta- 
cles. It is generally known that sound pulses are transformed into a frequency which reflects 
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from obstacles. The bats navigate by using the time delay from emission to reflection. They 
typically emit short, loud sound impulses. The pulse rate is usually defined as 10 to 20 
times per second. After hitting and reflecting, the bats transform their own pulse into useful 
information to gauge how far away the prey is. The bats are using wavelengths that vary 
in the range from 0.7 to 17 mm or inbound frequencies of 20-500 kHz. To implement the 
algorithm, the pulse frequency and the rate have to be defined. The pulse rate can be simply 
determined in the range from to 1, where means that there is no emission and 1 means 
that the bats' emitting is their maximum [J?l EZ] . 

The bat behaviour can be used to formulate a new BA. Yang [22] used three generalized 
rules when implementing the bat algorithms: 

1. All the bats use an echolocation to sense the distance and they also guess the difference 
between the food/prey and background barriers in a somewhat magical way. 

2. When searching for their prey, the bats fly randomly with velocity Vi at position X{ with 
fixed frequency f m in, varying wavelength A and loudness A . They can automatically 
adjust the wavelength (or frequency) of their emitted pulses and adjust the rate of 
pulse emission r e [0, 1], depending on the proximity of their target. 

3. Although the loudness can vary in many ways, we assume that it varies from a large 
(positive) A to a minimum constant value A min . 
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Algorithm 1 Original Bat Algorithm 
1: Objective function f(x), x = (x\, ...,Xd) T 

2: Initialize the bat population Xi and V{ for i = l ...n 

3: Define pulse frequency Qi e [Q m i n ,Qmax] 

4: Initialize pulse rates ri and the loudness A% 

5: while (t < T max ) / / number of iterations 

6: Generate new solutions by adjusting frequency and 

7: update velocities and locations/solutions [Eq.(2) to (4)] 

8: if(rand(0, 1) > rj ) 

9: Select a solution among the best solutions 
10: Generate a local solution around the best solution 
11: end if 

12: Generate a new solution by flying randomly 
13: if(rand(0, 1) < A { and f{xi) < f{x)) 
14: Accept the new solutions 
15: Increase ri and reduce Ai 
16: end if 

17: Rank the bats and find the current best 
18: end 

19: Postprocess results and visualization 



The original BA is illustrated in Algorithm [T] In this algorithm, the bat behaviour is 
captured into the fitness function of the problem to be solved. It consists of the following 
components: 

• initialization (lines 2-4), 

• generation of new solutions (lines 6-7), 

• local search (lines 8-11), 

• generation of a new solution by flying randomly (lines 12-16) and 

• find the current best solution. 
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Initialization of the bat population is performed randomly. Generating new solutions is 
performed by moving virtual bats according to the following equations: 



-Qmin)U(0,l), 

v^^vJ + CxJ-best)^, (1) 



(*) (t) 



where t/(0, 1) is a uniform distribution. A random walk with direct exploitation is used for 
the local search that modifies the current best solution according to equation: 



x 



(t) 



best + eAf ) (2f/(0,l)-l), (2) 



where e is the scaling factor, and Af the loudness. The local search is launched with 
the proximity depending on pulse rate r^. The term in line 13 is similar to the simulated 
annealing behavior, where the new solution is accepted with some proximity depending on 
parameter In line with this, the rate of pulse emission increases and the loudness 
Ai decreases. Both characteristics imitate the natural bats, where the rate of the pulse 
emission increases and the loudness decreases when a bat finds its prey. Mathematically, 
these characteristics are captured with the following equations: 

= *A®, r® = r< 0) [l - exp(-je)], (3) 



where a and 7 are constants. Actually, a 

parameter plays a similar role as the cooling factor in the simulated annealing algorithm 
that controls the convergence rate of this algorithm. 



III. DIFFERENTIAL EVOLUTION 

Differential evolution (DE) [29J [6J is a technique for the optimization introduced by Storn 
and Price in 1995. DE optimizes a problem by maintaining a population of candidate 
solutions and creates new candidate solutions by combining the existing ones according 
to its simple formulae, and then keeping whichever candidate solution has the best score 
or fitness on the optimization problem at hand. DE supports a differential mutation, a 
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differential crossover and a differential selection. In particular, the differential mutation 
randomly selects two solutions and adds a scaled difference between these to the third 
solution. This mutation can be expressed as follows: 



uf > = w$j + F- (w$ - w$ ) , for i = 1 . . . NP, (4) 

where F e [0.1, 1.0] denotes the scaling factor as a positive real number that scales the rate 
of modification while rO, rl, r2 are randomly selected vectors in the interval 1 . . . NP. 

A uniform crossover is employed as a differential crossover by DE. The trial vector is built 
out of parameter values copied from two different solutions. Mathematically, this crossover 
can be expressed as follows: 



Z i,j 



U 



(*) 
i,3 



randj(0, 1) < CR v j = j rand , 



(5) 

w\- otherwise, 

where CR e [0.0, 1.0] controls the fraction of parameters that are copied to the trial solution. 
Note, the relation j = jrand assures that the trial vector is different from the original solution 

Mathematically, differential selection can be expressed as follows: 



(t+i) 



'zf if 

(6) 

u> otherwise . 



In the technical sense, the crossover and mutation can be performed in many ways in 
DE. Therefore, a specific notation was used to describe the variety of these methods (also 
strategies) in general. For example, "DE/rand/l/bin" denotes that the base vector is ran- 
domly selected, one vector difference is added to it, and the number of modified parameters 
in the mutation vector follows the binomial distribution. 

IV. HYBRID BAT ALGORITHM 

As mentioned above, in this article we propose a new BA, called Hybrid Bat Algorithm 
(HBA). It was obtained by hybridizing the original BA using the DE strategies. The HBA 
pseudo-code is illustrated in Algorithm [2] 
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Algorithm 2 Hybrid Bat Algorithm 
1: Objective function f(x), x = (x\, ...,Xd) T 

2: Initialize the bat population Xi and V{ for i = l ...n 

3: Define pulse frequency Qi e [Q m i n ,Qmax] 

4: Initialize pulse rates ri and the loudness A% 

5: while (t < T max ) / / number of iterations 

6: Generate new solutions by adjusting frequency and 

7: updating velocities and locations/solutions [Eq.(2) to (4)] 

8: if(rand(0, 1) > rj ) 

9: Modify the solution using "DE/rand/l/bin" 

10: end if 

11: Generate a new solution by flying randomly 
12: if(rand(0, 1) < Ai and f{xi) < f{x)) 
13: Accept the new solutions 
14: Increase rj and reduce A4 
15: end if 

16: Rank the bats and find the current best 
17: end 

18: Postprocess results and visualization 

As a result, HBA differs from the original BA in lines 9-10, i.e., in the local search step. In 
exploring the search space in the vicinity of the best solution, a random solution is selected 
and modified using the "DE/rand/l/bin" strategy. 

V. EXPERIMENTS AND RESULTS 

The goal of our experiments was to show that HBA significantly improves the results of 
the original BA. For this purpose, two BAs were implemented according to specifications 
given in Algorithms [T] and [2] so that a well-selected set of test functions in the literature are 
used for optimization benchmarks. 

The parameters of the two BAs were the same. The dimension of the problem significantly 
affects the results 
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optimization. To test the impact of the problem dimension on the results, three different 
sets of dimensions were taken into account, i.e., D = 10, D = 20, and D = 30. The functions 
with dimension D = 10 were limited to maximally 1,000 generations, the functions with 
dimension D = 20 to twice as much, while the functions with dimension D = 30 to 3,000. 
The initial loudness was set to Aq = 0.5 and so was also the initial pulse rate (ro = 0.5). The 
frequency was taken from interval Qi e [0.0,2.0]. The algorithms optimized each function 
25 times and results were measured according to the best, worst, mean, and medium values 
in these runs. The standard deviation of the mean values was calculated as well. 



A. Test suite 



Our test suite consists of five standard functions taken from literature [32] ■ The functions 
in this test suite are represented below. 



1. The Griewangk's function 

The aim of the function is overcoming failures to optimize each variable independently. 
This function is multimodal, since the number of local optima increases with the dimension- 
ality. After dimensionalities are sufficiently high (n > 30), multimodality seems to disappear 
and the problem turns to be unimodal. 

D I „ \ D ™2 

A(5) = -ncos ] + y^-+i, (7) 

U ) U Wi) ,4x4000 1 ; 

where -600 < Xi < 600. The global minimum of the function is at 0. 



2. The Rosenbrock's function 

As in case of the Rastrigin's function, the Rosenbrock's function too, has its value at 
the global minimum. The global optimum is inside the parabolic, narrow-shaped flat valley. 
Variables are strongly dependent on each other, since it is difficult to converge the global 
optimum. 

D-l 

f 2 (xi) = £ 100 (x i+1 - x\f + (xi - l) 2 , (8) 
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where -15.00 < x { < 15.00. 



3. Sphere function 

/ 3 (^) = XX 2 , (9) 

where -15.00 < x^ < 15.00. 

4- The Rastrigin's function 

Based of the Sphere's function, the Rastrigin's function adds cosine modulation to create 
many local minima. Because of this feature, the function is multimodal. Its global minimum 
is at 0. 

Ufa) = n * 10 + f>f - 10cos(27r^)), (10) 
i=i 

where -15.00 < Xi < 15.00. 

5. The Ackley's function 

The complexity of this function is moderate because of the exponential term that covers its 
surface with numerous local minima. It is based on the gradient slope. Only the algorithm 
that uses the gradient steepest descent will be trapped in a local optimum. The search 
strategy, analyzing a wider area, will be able to cross the valley among the optima and 
achieve better results. 

/ 5 (x) = £[20+e - 20e- - 2 ^ - 5{x ^ +x * ) - 

(11) 

g0.5(cos(27nri + i)+cos(27r:Ei)) j 

where -32.00 < xi < 32.00. The global minimum of this function is at 0. 
B. PC configuration 

Configuration of PC used in our experiments is as follows: 
• HP Pavilion g4, 
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• processor Intel(R) Core(TM) i5 @ 2.40 GHz, 

• memory 8 GB, 

• implemented in C++. 



TABLE I: The results of experiments 



Alg. 


D 


Value 


fi 


h 


h 


h 


h 






Best 


3.29E+01 


1.07E+04 


5.33E+01 


6.07E+01 


1.37E+01 






Worst 


1.73E+02 


1.58E+06 


3.11E+02 


5.57E+02 


2.00E+01 




10 


Mean 


8.30E+01 


5.53E+05 


1.44E+02 


2.27E+02 


1.75E+01 






Median 


3.91E+01 


4.69E+05 


6.44E+01 


1.06E+02 


1.68E+00 






StDev 


6.94E+01 


4.71E+05 


1.48E+02 


2.17E+02 


1.73E+01 






Best 


8.77E+01 


3.41E+02 


2.24E+02 


7.28E+01 


2.15E+02 


BA 


20 


Worst 
Mean 


1.43E+02 
1.46E+00 


1.02E+03 
6.87E+02 


5.72E+02 
3.56E+02 


2.02E+02 
1.82E+02 


5.87E+02 
3.38E+02 






Median 


1.90E+05 


3.16E+06 


1.08E+06 


9.20E+05 


7.50E+05 






StDev 


1.64E+01 


2.00E+01 


1.85E+01 


1.21E+00 


1.80E+01 






Best 


1.58E+02 


4.95E+02 


3.29E+02 


8.74E+01 


3.39E+02 






Worst 


4.18E+02 


1.67E+03 


7.80E+02 


2.64E+02 


7.82E+02 




30 


Mean 


1.51E+02 


1.01E+03 


5.17E+02 


2.12E+02 


4.67E+02 






Median 


4.66E+05 


6.23E+06 


2.10E+06 


1.26E+06 


2.06E+06 






StDev 


1.52E+01 


2.00E+01 


1.79E+01 


1.25E+00 


1.76E+01 






Best 


2.25E-09 


6.34E-02 


4.83E-09 


5.12E+00 


6.31E-04 






Worst 


3.97E-05 


5.10E+02 


2.89E-03 


2.38E+01 


2.00E+01 




10 


Mean 


3.18E-06 


6.22E+01 


1.26E-04 


1.55E+01 


1.16E+01 






Median 


8.66E-06 


1.15E+02 


5.66E-04 


4.46E+00 


9.26E+00 






StDev 


1.14E-07 


7.73E+00 


1.66E-07 


1.69E+01 


1.78E+01 






Best 


1.01E-07 


9.73E-03 


4.83E-04 


1.89E-03 


3.70E-05 


HBA 


20 


Worst 
Mean 


2.96E+01 
8.56E-07 


9.24E+01 
1.10E-01 


5.47E+01 
5.87E-03 


1.77E+01 
2.18E-02 


5.48E+01 
3.82E-05 






Median 


3.60E+01 


1.44E+03 


2.53E+02 


3.10E+02 


1.41E+02 






StDev 


2.17E+00 


2.00E+01 


1.60E+01 


6.18E+00 


1.95E+01 






Best 


6.38E-06 


8.28E+00 


3.37E-01 


1.62E+00 


5.43E-04 






Worst 


3.57E+01 


2.17E+02 


9.97E+01 


3.98E+01 


9.85E+01 




30 


Mean 


6.42E-05 


6.59E+01 


3.09E+00 


1.29E+01 


2.53E-03 






Median 


5.99E+01 


4.00E+03 


7.67E+02 


1.26E+03 


2.15E+02 






StDev 


3.12E+00 


2.00E+01 


1.72E+01 


5.03E+00 


1.94E+01 
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C. Experiment results 

The results of our extensive numerical experiments are summarized in Table [T| The table 
represents results of BA and HBA algorithms (column 1) solving the test suite of five func- 
tions (denoted as fi, /2, /3, /4, /s) with dimensions D = 10, 20 and 30, respectively, according 
to the best, worst, mean, median, and standard deviation values. 

The results of the HBA algorithm show that this algorithm significantly improves the 
results of the original BA algorithm according to almost all the measures safe for the standard 
deviation in some cases (e.g., when using Ackley's function). There was no statistical analysis 
of the results made because they are evidently better for HBA than for BA. 

To show how the results of the two algorithms (i.e., BA and HBA) vary with the di- 
mensions of the functions, the mean value of functions f\ and f'3 with dimensions D = 10, 
D = 20, and D = 30 are presented in Figs. [T](3j The logarithmic scale is used to display the 
mean value on the y-axis. The higher the mean value, the more difficult the function is to 
solve. 
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FIG. 1: Mean value of function f\ with various dimensions. 



As seen from Fig. [TJ the best results are obtained by optimizing function fx with the di- 
mension D = 20, while the worst by optimizing the same function with the highest dimension 
D = 30. 

It is interesting to note that the mean value of function /s with dimension D = 10 is 
most difficult to obtain for the HBA algorithm, while the same function but with dimension 
D = 20 is the easiest to solve. Oppositely, the results of the original BA algorithm show that 
by increasing the dimensions, the results become worsen. 
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FIG. 2: Mean value of function f% with various dimensions. 
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FIG. 3: Mean value of function f§ with various dimensions. 

As seen from Fig. [2j solving function f'3 becomes more efficient when the dimensionality 
of the problem increases. As a result, the most difficult function to solve is function fa with 
dimension D = 30. 

Comparing the results obtained with the BA and the HBA algorithm shows that the re- 
sults of HBA significantly outperform the results of the original BA algorithm by optimizing 
the functions fx, fs, and fa. Functions /2 and of the HBA algorithm are also better, but 
the difference is not significant. 

VI. CONCLUSION 



In this paper we improve the bat algorithm, BA, by developing its new variant, the so- 
called hybrid bat algorithm, HBA. HBA is a hybrid of BA with DE strategies. As shown 
with our experiments, HBA improves significantly the original variant of BA. In future, HBA 
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will be tested on a large-scale global optimization. Our testing will be extended by using 
more diverse test function sets and by deepening our parametric study. 
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